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PREFACE  AMD  SUMMARY 

A  method  for  converting  certain  optimisation  problems  in  the 
calculus  of  variations  into  Cauchy  problems  is  presented.  Ho  direct 
use  of  Euler  equations  or  dynamic  programming  is  involved.  This 
provides  a  new  conceptual  framework  for  variational  problems  with 
both  computational  and  analytical  advantages. 

This  Memorandum  may  be  of  interest  to  applied  mathematicians, 
control  theorists,  and  numerical  analysts. 

Dr.  Sridhar  is  a  member  of  the  Department  of  Electrical  En¬ 
gineering,  California  Institute  of  Technology. 
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I.  INTRODUCTION 

In  recent  years  methods  have  been  developed  for  transforming 

various  classes  of  functional  equations  Into  Initial-value  problems. 

One  of  the  motivations  is  that  current  computing  machines  can  fre- 

(1  21 

quently  hf-tdle  such  Cauchy  problems  with  accuracy  and  dispatch.  * 
Among  the  classes  considered  have  been  two-point  boundary-value 
problems, ^  Fredholm  integral  equations, ^  and  multi-point 
boundary-value  problems. 

It  will  be  shown  that  certain  variational  problems  can  be 
transformed  directly  into  Cauchy  problems,  without  using  Euler 
equations  or  dynamic  programming.  This,  in  effect,  provides  a  new 
conceptual  framework  for  attacking  variational  problems  with  obvious 
computational  advantages  and  attractive  analytical  features  for  future 
exploitation. 


2 


A 


II.  DERIVATION  OF  THE  EQUATIONS 

Consider  the  minimisation  of  the  Integral 

T 

I(v)  -  J  f<y,w,w)  dy  ,  (1) 


where 


w  -  w(y)  ,  a  <  y  £  T  , 


and 


dy 

dy 


Furthermore ,  let 


v(a)  -  c  , 


(2) 


(3) 


with  w(T)  being  free.  Let 


w  -  x  -  x(y,a,c)  (4) 

be  the  minimizer.  For  an  arbitrary  admissible  variation  71(y), 
a  <  y  £  T,  with 

T)<«>  -  0  ,  (5) 

a  necessary  condition  on  x  is  that  tha  first  variation  of  tha  Inte¬ 
gral  in  Eq.  (1)  be  zero.  This  leads  to  the  equation 

T 

J  [0<y.x,x)  71  +  cr(y,x,x)  71]  dy  -  0  ,  (6) 
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where 

«<y,w,ii)  -  —  ,  (7) 

&w 

end 

e(y,w,w)  -  —  .  (8) 

aw 

Suitable  integration  by  parts  in  Eq.  (6)  and  use  of  the  fundamen¬ 
tal  lemma  of  the  calculus  of  variations  would  lead  to  the  Euler  equation. 
The  procedure  to  be  used  below  is  different. 

The  choice  of  the  admissible  variation 

II,  a  S  y  <  t  , 

(9) 

0,  t  <  y  <  T  , 

transforms  Eq.  (6)  into  the  differential  integral  equation 
t  T 

J  a(y,x,x)  dy  +  J  e(y,x,x)  ^  dy  -  0  .  (10) 

a  a 

From  Eqs.  (5)  and  (9),  assuming  continuity,  it  follows  that 

T)(y)  “  k(t,y,a)  -  min(t-a.y-a)  .  (11) 

From  Eqs.  (10)  and  (11)  it  is  seen  that 

t  T 

J  o(y,x,x)  dy  +  J  k(t,y,a)  8(y,x,x)  dy  -  0  . 


(12) 
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Differentiating  both  aides  of  Eq.  (12)  with  respect  to  the  variable  t 
leads  to  the  relation 

T 

a(t,  x(t),  x(t)y  +  J*  kt(t,y,a)  0(y,x,x)  dy  -  0  .  (13) 


From  Eq.  (11)  we  find 


kt(t,y,a)  - 


0  ,  y  <  t  , 

1  ,  y  >  t  . 


(14) 


From  Eqs.  (13)  and  (14)  it  follows  that 


or(t,x,x)  +  J  £(y,x,x)  dy  -  0 


(15) 


We  wish  to  study  the  minlmizer  x  as  a  function  of  c  and  a.  Thus, 
when  necessary,  we  shall  write 

x  -  x(y  ,a,c)  ,  a  <  y  s  T  ,  -®<c<®,  (16) 

and  Eq.  (15),  in  full,  will  be  written  as 

T 

or^t ,  x(t,a,c),  x(t,a,c))  +  J  p(y,  x(y,a,c),  x(y,a,c))  dy  -  0  .  (17) 

t 

Another  differentiation  with  respect  to  t  of  Eq.  (17)  would  yield  the 
Euler  equation.  We  shall  proceed  along  different  lines.  In  Eq.  (17), 
as  well  as  in  further  developments,  the  dot  refers  to  partial  differen¬ 
tiation  with  respect  to  the  first  variable.  The  condition  specified 
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by  Eq.  (4)  is  equivalent  to 


x(a,a,c)  -  c  ,  (18) 

or,  written  differently, 

x(t,t,c)  -  c  .  (18) 

Differentiation  of  Eq.  (17)  with  respect  to  a  leads  to  the  linear 
integro-differential  equation  for  the  partial  derivative  xfl, 

T 

<*w(t,X,x)  xa  +  ^(t.x.x)  xa  +  |  {Bw(y,x,x) 

+  ^(y.x.x)  xfl}  dy  -  0  ,  (19) 

where 

xa  “  U  (t’a’c>  •  <20> 

Taking  the  total  derivative  with  respect  to  a  of  both  sides  of  Eq.  (18) 
results  in  the  formula 


x(a,a,c)  +  xa(a,a,c)  -  0  .  (21) 

Differentiation  of  Eq .  (17)  with  respect  to  c  leads  to  the  linear 
integro-differential  equation  for  the  partial  derivative  xc , 

T 

o-w(t,x,x)  xc  +  o^t.x.x)  xc  +|  (Pw(y,x,x)  X(_ 

+  0^(y,x,x)  xc)  dy  -  0  . 


(22) 
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In  Eqs .  (19)  and  (22) 

<*w(y.w.w)  *  |~  (y.w.w)  ,  (23) 

where  a  is  defined  in  Eq.  (7).  The  variable  a ^  is  similarly  defined. 
Taking  the  total  derivative  with  respect  to  c  of  both  sides  of  Eq.  (18) 
results  in 

xc(a,a,c)  -  1  .  (24) 

It  is  seen  from  Eqs.  (19)  and  (22)  that  the  functions  x  and  x 

A  C 

satisfy  identical  linear  homogeneous  integro-dif ferentlal  equations. 

The  initial  conditions  given  by  Eqa.  (21)  and  (24),  though,  are  dif¬ 
ferent  for  theae  functiona.  Assuming  uniqueneaa,  it  follows  that 


xa(t,a,c)  -  -  x(a,a,c)  xc(t,a,c)  . 


Define 


p(a,c)  *  x(a,a,c)  . 


Equation  (25)  becomes 

xa(t,a,c)  -  -  p(a,c)  xc(t,a,c)  ,  aft. 


(25) 


(26) 


(27) 


Equation  (27)  is  the  partial  differential  equation  satisfied  by  x.  It 
has  to  be  solved  with  the  initial  condition  specified  by  the  second 
Eq.  (18).  We  now  have  to  determine  p(a, c)  before  Eqs.  (27)  and  (18) 
can  be  solved. 

Define 

ar(a,  x(a,a,c),  x(a,a,c))  -  r(a,c)  .  (28) 


L 


From  Eqs .  (18),  (26).  and  (28),  it  follows  that 


r(a,c)  -  or(a,c,  p(a,c))  . 


Assuming  that  Eq.  (29)  is  invertible,  r(a,c)  determines  p(a,c).  We 
will  now  derive  the  partial  differential  equation  and  associated  initial 
condition  satisfied  by  r(a,c).  When  t  *  a,  Eqs.  (17)  and  (29)  lead  to 


•(a,c)  +  J  3^y,  x(y,a,c),  x(y,a,c))  dy  -  0  . 


Taking  partial  derivatives  with  respect  to  a  on  both  sides  of  Eq.  (30) 
leads  to  the  equation 


rft(a,c)  -  p(a,  x(a,a,c),  x(a,a,c))  +  J  {Pw(y,x,x)  xfl 


+  P^(y.x.x)  xa}  dy  ■  0  .  (31) 


From  Eqs.  (18),  (26),  (27),  and  (31),  it  follows  that 


ra(a,c)  -  e(a,c,  p(a,c))  -  p(a,c)  J  Uw(y,x,x) 


+  P^(y.x.x)  xcJ  dy  -  0 


Taking  partial  derivatives  with  respect  to  c  on  both  sides  of 

Eq.  (30)  leads  to  ths  equation 

T 

rc(a,c)  +  J  Uw(y,x,x)  xc  +  8^(y,x,x)  xc}  dy  -  0  .  (33) 
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Equation*  (32)  and  (33)  result  in  tha  daalrad  foraula 

ra(a,c)  +  p(a,c)tc(a,c)  -  B(a,c,p(a,c))  .  (34) 

From  Eq.  (30)  it  1*  evident  that 

r(T,c)  -  0  .  (35) 

The  partial  differential  Eq.  (34),  the  finite  Eq.  (24),  and 
Eq.  (35)  constitute  an  initial-value  problem  for  the  functions  r(a,c) 
and  p(a,c) . 

In  practice  the  function  r  could  be  determined  first  and  stored, 
and  then  the  function  x  could  be  determined.  To  avoid  storage  prob¬ 
lems  in  the  digital  computer,  the  functions  r  and  x  could  be  deterained 
simultaneously. 
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III.  DISCUSSION 

A  aethod  for  directly  obtaining  the  initial-value  problem 

associated  with  the  slop lest  problem  in  the  calculus  of  variations 

has  been  presented.  It  is  contained  in  Eqs.  (27),  (18),  (34),  (35), 

and  (29).  Extensions  of  this  method  to  more  general  problems  in 

the  calculus  of  variations,  as  well  as  in  optimal  control  theory, 

(6) 

are  under  atudy. 


10 


> 


references 


1.  Bellman,  R.  E. ,  H.  H.  Kaglwada,  and  R.  E.  Kalaba,  "Invariant 

Imbedding  and  the  Numerical  Integration  of  Boundary-Value 
Problem*  for  Unstable  Linear  Systems  of  Ordinary  Differential 
Equations,"  Coma.  AQI,  Vol.  10,  No.  2,  February  1967, 

pp.  100-102. 

2.  Kaglwada,  H.  H. ,  R.  E.  Kalaba,  A.  Schumitzky,  and  R.  Srldhar, 

"Cauchy  and  Fredholm  Methods  for  Euler  Equations,"  J.  Optimiza¬ 
tion  Theory  and  Appl. .  Vol.  2,  No.  3,  May  1968,  pp.  157-163. 

3.  Bellman,  R.  E. ,  H.  H.  Kaglwada,  R.  E.  Kalaba,  and  R.  Srldhar, 

"Invariant  Imbedding  and  Nonlinear  Filtering  Theory,"  J.  Astro. 
Sci. .  Vol.  XII,  No.  3,  May-June  1966,  pp.  110-115. 

4.  Kaglwada,  H.  H. ,  and  R.  E.  Kalaba,  "An  Initial- Value  Method 

Suitable  for  the  Computation  of  Certain  Fredholm  Resolvents," 

J.  Math.  Phys.  Sci. .  Vol.  1,  Nos.  1  and  2,  June  1967, 
pp.  109-122. 

5.  Meyer,  G.  H. ,  "The  Invariant  Imbedding  Equations  for  Multi-Point 

Boundary-Value  Problems,"  Notices  of  the  AMS.  Abstract  658-143, 
Vol.  15,  No.  5,  August  1968,  p.  761. 

6.  Kalaba,  R.  E. ,  and  R.  Srldhar,  Initial-Value  Methods  in  Optimal 

Control  Theory.  The  RAND  Corporation,  RM-5754-FR,  to  be  published. 


1  ORIGINATING  ACTIVITY 

2a  REPORT  SECURITY  CLASSIFICATION 
UNCLASSIFIED 

THE  RAND  CORPORATION 

2b.  GROUP 

3.  REPORT  TITLE 

an  initial- value  method  for  the  simplest  problem  in 

THE  CALCULUS  OF  VARIATIONS 

4.  AUTHOR(S)  (Lost  mim,  first  mm , Initial) 

Kalaba,  R.  and  R.  Sridhar 

3.  REPORT  DATE 

September  1968 


7.  CONTRACT  OR  6RANT  No. 

F44620-67-C-0045 


9o.  AVAILABILITY  /  LIMITATION  NOTICES 
DDC-1 


10.  ABSTRACT 


60.  TOTAL  No.  OF  PAGES 


6b.  No.  OF  REFS. 


&  ORIGINATOR  S  REPORT  No. 

RM-5737-PR 


9b.  SPONSORING  AGENCY 
United  States  Air  Force 
Project  RAND 


II.  KEY  WORDS 


A  presentation  of  a  method  for  converting 
certain  optimization  problems  In  the  cal¬ 
culus  of  variations  Into  initial-value 
problems  that  can  be  solved  effectively 
by  analog  or  digital  computers.  No  direct 
use  of  Euler  equations  or  dynamic  program¬ 
ming  is  involved.  This  provides  a  new  con¬ 
ceptual  framework  for  variational  problems 
that  has  both  computational  and  analytical 
advantages. 


Mathematics 

Optimization 

Numerical  methods  and  processes 
Differential  equations 
Integral  equations 
Control  theory 
Computer  programming 


